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BACKGROUND OF THE INVENTION 

This invention relates to a method of grouping or clustering clients within a network to 
optimize and expedite the flow of data within the network. 

Servers, such as proxy servers, cache servers, content distribution servers, mirror servers 
and other related servers are typically used to speed the access of data and reduce response time 
for network client requests in a network, such as the World Wide Web. Generally, these network 
clients issue requests for information, such as in the form of a Hypertext Transfer Protocol 
(HTTP) requests for some information, such as one or more Web pages. These requests are then 
handled directly or indirectly by these servers, such as proxy servers, caches servers, content 
distribution servers and mirror servers, to hopefully expedite the accessing and transfer of the 
requested information. 

Generally, these servers either act as intermediaries or as transfer or redirection points for 
client requests in the network. For example, in operation, a proxy server receives a request for 
an Internet service (such as a Web page request) fi-om a user. If the request passes filtering 
requirements, the proxy server looks in its local cache of previously downloaded Web pages. If 
the server fmds the page, the page is returned to the user without needing to forward the request 
to, for example, a World Wide Web server on the Intemet. If the page is not in the cache, the 
proxy server, acting as a client on behalf of the user, requests the page fi-om the server out on the 
Intemet. When the page is returned, the proxy server relates it to the original request and 
forwards it on to the client user. 



AWARE CLUSTERING OF WEB CLIENTS/PROXIES. 
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Strategically designing placement of proxies in the network can benefit greatly from 
clustering network client users who are from the same network together so that the proxy server 
can adequately and efficiently serve these respective client clusters. Mis-characterizing clients 
as being in the same network may result in a proxy server being placed such that it impracticably 
5 and inefficiently serves these clients resulting in degraded performance in the network. 

In the case of, for example, a cache or a content distribution server, the user's HTTP 
request at an originating server is typically re-routed away from the originating server and on to a 
cache server "closer" to the user. Generally, the cache server determines what content in the 
10 request exists in the cache, serves that content, and retrieves any non-cached content from the 
originatmg server. Any new content may also be cached locally in the cache server. 

Similar to the strategic placement of proxies, the placement of cache servers, content 
distribution "boxes" or servers and related mirror servers can be best made by accurately 
15 clustering clients together in the network. Performance in the network may thus be improved by 
accurately and properly clustering multiple network clients together in related client clusters. 
The servers, whether they are cache servers, content distribution servers and/or mirror servers 
can then efficiently service these client clusters. 

20 Accordingly, it would be desirable to have a method for accurately clustering clients 

within a network together to guide placement of proxies, cache servers, content distribution 
servers and mirror servers within the network. 
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SUMMARY OF THE INVENTION 

The present invention is a method for guiding placement of servers, such as proxy 
servers, cache servers, content distribution servers and mirror servers within a distributed 

5 information network. The method uses information from at least one network log, such as a 
server log or proxy log, and at least one network routing table to arrange clients into related 
client clusters. In one embodiment, the method includes the steps of generating a unified 
prefix/netmask table from a plurality of extracted prefix/netmask entries, extracting a plurality of 
client IP addresses from the at least one network log, comparing each of the plurality of client IP 

10 addresses with entries in the unified/prefix netmask table to determine a common longest 
matching prefix between each of the plurality of client IP addresses and the entries in the 
unified/prefix netmask table and grouping all of the client IP addresses which share the common 
longest matching prefix into at least one client cluster. Each client wdthin a client cluster will 
share a common network address prefix from the unified routing table with the other clients in 

15 the same client cluster. 

Preferably, a number of different routing table snapshots are used in extracting entries for 
the unified prefix/netmask table. These multiple entries from the different prefix/netmask tables 
are unified into a singular format and then merged into a single table. 

20 

Network servers, such as proxy servers, cache servers, content distribution servers and 
mirror servers may be assigned to one or more clusters based on a number of factors such as the 
number of clients within the cluster, the number of requests issued, the URLs accessed and the 
number of bytes fetched from a server, such as a Web server. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 illustrates an exemplary network configuration in accordance with the teachings of the 
present invention. 

FIG. 2 illustrates an exemplary method in accordance with the teachings of the present invention. 

FIG. 3 illustrates an exemplary routing table containing routing information. 

FIG. 4 illustrates an exemplary method for creating a unified routing table in accordance vnih the 
teachings of the present invention. 

FIG. 5 illustrates an exemplary table containing routing information and unified routing 
information. 

FIG. 6 illustrates an exemplary method for clustering clients in accordance with the teachings of 
the present invention. 



DETAILED DESCRIPTION OF THE INVENTION 



United States provisional application No. 60/151,194, titled SYSTEM AND METHOD 
FOR NETWORK- AWARE CLUSTERING OF WEB CLIENTS/PROXIES filed August 27, 
5 1999 is hereby incorporated by reference herein in its entirety. 

The present invention relates to a method for clustering clients and allocating servers, 
such as proxy servers, cache servers, content distribution servers and mirror servers, to those 
client clusters in a distributed information network, such as the World Wide Web. Referring to 

10 FIG. 1, an exemplary network 10 configured in accordance with the teachings of the present 
invention is shown. The network 10 includes a number of clients, such as clients 20 (CI, 
C2. . ..Cn) which are clustered together in a client cluster 30, clients 40 (CAl, CA2, CA3 
. . ...CAn) which are clustered together in a client cluster 50 and clients 60 (CBl, CB2. . ..CBn) 
which are clustered together in a client cluster 70. Client cluster 30 is in communication with 

15 servers 32, 34 which together form a server cluster 36, client cluster 50 is in communication with 
servers 52, 54 and 56 which form a server cluster 58 and client cluster 70 is in communication 
with a single server 72. In the present invention, servers 32, 34, 52, 54, 56 and 72 may be any 
one of proxy servers, cache servers, content distribution servers and/or mirror servers. For 
example, server 32 and server 34 may be proxy servers such that server cluster 36 is a proxy 

20 server cluster. 




Server cluster 36 inducing servers 32 and 34, server cluster 58 including servers 54, 56 
and 58 and server 72 are in fiir her communication with a server, such as a World Wide Web 
server 90. World Wide Web sijrver may be any server available on the Internet which is 
25 responsive to requests to and fiom any one of the clients and/or servers. For example, World 
Wide Web server may be a ser /er which receives and responds to requests for Web pages related 
to one or more Web sites whicm are resident on the server. Other network configurations are 
possible provided the network servers, such as the network proxy servers, cache servers, content 
distribution servers and mirror servers are allocated to properly clustered client clusters as 
30 discussed in more detail later herein. 



In the present invention, the placement and configuration of the servers and server 
clusters, such as the proxy servers and related proxy server clusters, cache servers and related 
cache server clusters, content distribution servers and content distribution server clusters and 
mirror servers and related mirror server clusters depends on the clustering of clients within the 

5 network. For example, using a content caching scheme for illustrative purposes, a client may 
issue a request for content, such as HTTP request to a World Wide Web server. This may be 
performed by the Web client clicking on a URL that is "content-delivery enabled", i.e. the URL 
includes the use of a special routing code that redirects the Web page request to the optimum or 
"closest" server. This "content-delivery enabled" URL will re-route that client's request away 

10 from the site's originating Web server and on to a cache server or cache server cluster, that is 
better suited to serve the client. 



Referring to FIG. 2, an exemplary embodiment of a method for clustering clients and 
assigning or allocating servers to these client clusters is shown. In this embodiment, a unified 

15 routing information table is created, step 110. The xmified routing information table, preferably 
includes routing information fi^om one or more routing tables, such as network routing prefix and 
netmask information. For background purposes, a netmask is a series of bits designed to "mask" 
or conceal certain portions of an IP address. Typically, the standard netmask for a class C 
network like is 255.255.255.0 where the "255.255.255" prefix portion identifies the network 

20 number and the last octet, ".0", is the actual machine number or subnetwork number. Referring 
again to FIG. 2, clients within the network are classified into client clusters based on information 
from the unified routing information table, step 120. Servers, such as proxy servers, cache 
servers, network distribution servers and minor servers may then be assigned to these client 
clusters, step 130, as discussed in more detail later herein. 

25 

As shown in FIG. 2, the present invention utilizes routing table information fi"om, 

preferably, two or more routing tables to create a unified routing information table. For 

background purposes, a router is a device or, in some cases, software in a computer, that 

determines the next network point to which a packet should be forwarded toward its destination. 

30 The router decides vAnch way to send each information packet based on its current 

understanding of the state of the networks it is connected to. Typically, routers create or 
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maintain a routing table of the available routes and their conditions and uses this information 
along with distance and cost algorithms to determine the best route for a given packet. An 
exemplary routing table or routing table "snapshot" 160 is shown in FIG. 3. As shown, the 
routing table or routing table snapshot 160 may include information such network prefix and 
5 netmask information 170, network identification information 180 and AS path information 190. 
Other additional information such as next hop IP address and AS number, etc may also be 
available via the network routing table. In an exemplary embodiment, as discussed above, 
information fi:om a plurality of routing tables are used to create the unified routing table for use 
in clustering clients together. 

10 

Referring to FIG. 4, an exemplary method for creating a unified routing table is shown. 
To create the unified table, a number of prefix/netmask entries are extracted fi"om a number of 
Q routing tables or routing table snapshots, step 200. Although only a single routing table or 

If routing table snapshot may be used, preferably two or more routing tables or routing table 

y = 

15 snapshots are used since any one table is unlikely to contain the desired information on all the 

ijj 

H necessary prefix/netmask entries. Each router in a network such as the World Wide Web will 
typically only see a limited set of traffic, thereby it is desirable to use a multiplicity of different 

4= 

B routing tables fi-om different routers in order to obtain a more complete set of routing 

information. The prefix/netmask entries fi-om the various tables are unified into a single 

nj 20 standardized format, step 210, as discussed in more detail later herein. The standardized 

yj 

Q prefix/netmask entries are then merged into a single unified table, step 220, to aid in clustering 
together clients in the network. Typically, the unified routing table will be created periodically 
to incorporate possibly updated information fi-om the routing tables in the network. The unified 
routing table may be created or generated at any interval such as every two hours, once a month 
25 or ten times a year as desired. 

Referring to FIG. 5, a network prefix/netmask entry may be m one of three formats as 

shown in a tabular form. A first exemplary format 230 is configured generally as 

Xl.x2.x3.x4/kl.k2.k3.k4 and is used m exemplary routing tables MAE-EAST, MAE- WEST, 

30 PACBELL AND PAIX, where xl .x2.x3.x4/kl .k2.k3.k4 are network prefix and netmask 

respectively with zeroes dropped at the end or tail. One such example is 193. 1/255.255, which 
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corresponds to 193.1.0.0/255.255.0.0, where 193.1.0.0 and 255.255.0.0 are network prefix and 
netmask, respectively. 



<^-to>;>Referring again to Fid. 5, another exemplary network prefix/netmask entry format 240 

x2.x3.x4/l as in routing tables at ARIN, AT&T, CANET, NLANR 
.x4 is the prefix and 1 is the netmask length. For example, 



^fri^^also be configured as xl 
AND VBNS, where xl.x2.x2 



128.148.0.0/16 stands for 128.148.0.0/255.255.0.0, where 128.148.0.0 and 255.255.0.0 are 



network prefix and netmask. 



Additionally, another exemplary prefix/netmask entry format may 



be configured as xl ,x2.x3.0 y^hich can also be found in CANET, and is an abbreviated 
10 representation of xl.x2.x3.0^kl.k2.k3.0. For example, 130.15.0.0 is an abbreviated 

representation of 130. 15.0.0/255.255.0.0. Of course, other formats may exist and may be 
utilized herein provided the ( ifferent formats are standardized to a singular format to aid in 
clustering clients in the network. 



15 In the present invention, the network prefix/netmask entries are unified into a single 

standardized format as previously discussed herein and shown as step 210 in FIG. 4. Any one of 
the formats as discussed above or other network prefix/netmask formats that may exist will 
preferably be converted into this single standardized format. In one exemplary embodiment, the 
format xl .x2.x3.x4/kl .k2.k3.k4 is chosen as the standardized format. For instance, any network 

20 prefix/netmask entries in the format of xl .x2.x3.x4/l and/or the format xl .x2.x3.0 will be 
converted into the format xl.x2.x3.x4/kl .k2.k3.k4 such that prefix/netmask entries 
128.148.0.0/16, 130.15.0.0 and 192.75.72.0 will be converted respectively into 128.148/255.255, 
130.15/255.255 and 192.75.72/255.255.255. These converted prefix/netmask entries are then 
tabulated into a single unified table with prefix/netmask entries existing in all the same format. 

25 This table may be in a simple tabular form with the multiple prefix/netmask entries listed in a 
grid array form. 
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Referring now to FIG. 6, an exemplary method for clustering clients using the unified 

prefix/netmask table is shown. A number of client IP addresses are first extracted from a 

network server log, step 300. The server log may be any generally available server log, such as 

a World Wide Web server log which collects client request information to the Web server. The 
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extracted client IP addresses are matched with the entries in the unified prefix/netmask table to 
determine a common network address prefix, step 3 1 0. Such matching may be performed by 
conducting a longest prefix matching on each client IP address with each of the entries in the 
unified prefix/netmask table. Once prefix matching has been performed, the client IP addresses 

5 are clustered into respective client clusters, step 320. In each respective client cluster, each of 
the clients within a client cluster will share a common prefix, or more specifically, a common 
longest matching prefix from the unified prefix/netmask table. A threshold for prefix matching 
may be set such that a client IP address has to have at least a certain number of matching digits in 
the client IP address prefix v^th any one of the prefix/netmask entries in the imified 

10 prefix/netmask table before a match is declared. For example, in one embodiment, a client IP 
address may have to prefix match at least four digits of any one of the prefix/netmask entries in 
the unified prefix/netmask table to be considered a match. 



Once clients have been clustered together in client clusters as discussed above, servers, 

^ - 

0 15 such as proxy servers, cache servers, content distribution servers and/or mirror servers may be 
M placed or assigned to these client clusters. Preferably, in the case of proxy servers, the proxy 

servers being assigned to these client clusters will be fiuictioning as cache servers and thereby 
- their optimum assignment or placement will depend greatly on the proper clustering of these 

S clients. In the present invention, the servers may be assigned to these client clusters based on 

1 20 one or more factors or metrics such as the number of clients, the number of requests issued, the 
Cj URLs accessed, the number of bytes fetched from a server and other related factors. In one 

embodiment, more than one server, such as a proxy server, cache server, content distribution 
server and/or mirror server may be assigned to the same client cluster or clusters such that the 
servers will together form a server cluster, as discussed earlier herein. The servers within a 
25 server cluster will act in concert with one another to service their respective client cluster(s). 

In one example, proxy servers, cache servers, content distribution servers and/or mirror 

servers may be assigned to a client cluster based simply on the number of clients in the 

respective client cluster. For example, a client number threshold may be set such that a server 

30 may be assigned for every instance of the client number threshold reached. A threshold may be 

set at any number such as 100, 500 or a 1000 clients. In an exemplary embodiment, where the 
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client number threshold is set at 500, a client cluster containing 4000 clients will require and be 
assigned at least eight (8) servers, whether they may be proxy servers, cache servers, content 
distribution servers and/or mirror servers. These eight servers together will form a server cluster 
which will be placed in front of the client cluster in the network to service the clients requests to 
and from the Internet. 

In another example, proxy servers, cache servers and/or content distribution servers may 
be assigned to one or more client clusters based on the number of requests, such as HTTP 
request, which are issued by the clients within each respective client cluster. For example, a 
request threshold may be set such that a server may be assigned for client clusters which issue a 
certain number of requests which equals or exceeds the threshold. A threshold may be set at any 
number depending on the anticipated capacity of the server to be assigned to the client cluster. 

In another exemplary embodiment, at least one server, such as a proxy server, cache 
server, content distribution server and/or mirror server, may be placed in front of each client 
cluster. The servers may be further grouped into server clusters based on their respective AS 
numbers and respective geographical locations. In this example, all servers belonging to the 
same AS and located geographically nearby v^U be grouped together to form a server cluster. In 
addition, in some instances, undesirable network spiders and conflicting proxy servers are 
eliminated from a client cluster before placing a server, such as a proxy server, cache server, 
content distribution server and/or mirror server to server that client cluster. 

It will be apparent to those skilled in the art that many changes and substitutions can be 
made to the system and method described herein without departing from the spirit and scope of 
the invention as defined by the appended claims. 
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